Bias in consensus scoring, with examples from ability emotional intelligence tests.
نویسندگان
چکیده
Consensus scoring occurs when the scoring key for a test is based upon the responses of the norm group. Consensus scoring is an attractive alternative to traditional methods of creating a scoring key for ability tests, especially useful when experts disagree about the correct answers to test items, as they do in the area of emotions and emotion perception. Of the many variations of consensus scoring, mode consensus scoring (the most frequent response in a norm group is given a score of 1, and all other responses a score of 0) and proportion consensus scoring (each respondent's score on an item is equal to the proportion of the norm group who match the respondent's answer) are the most widely used and the most psychometrically promising. This paper demonstrates that mode consensus scoring is biased against smaller sub-groups within the norm group: when sub-groups differ in their modal responses, the size of the sub-groups will influence the average group score. No known scoring option eliminates this bias. In contrast, proportion consensus scoring is not necessarily biased against smaller groups, although bias does occur in some extreme situations. Proportion consensus scoring is therefore the preferred consensus scoring option at this time.
منابع مشابه
A psychometric evaluation of the Mayer–Salovey–Caruso Emotional Intelligence Test Version 2.0
There has been some debate recently over the scoring, reliability and factor structure of ability measures of emotional intelligence (EI). This study examined these three psychometric properties with the most recent ability test of EI, the Mayer–Salovey–Caruso Emotional Intelligence Test (MSCEIT V2.0; Mayer, Salovey, & Caruso, [Mayer, J. D., Salovey, & P., Caruso, (2000). Models of emotional in...
متن کاملA negative correlation between self-regulation learning strategies and emotional intelligence: a new finding
By the advent of the 20th century, psychologists presented different learning theories; to the extent that one should consider this century as the time of prosperity and evolution of learning theories. Before 1950s, it was generally believed that learning was due to the impact of external stimulus, but from the 1950s onwards, researchers were challenged and conducted a series of studies that sh...
متن کاملA negative correlation between self-regulation learning strategies and emotional intelligence: a new finding
By the advent of the 20th century, psychologists presented different learning theories; to the extent that one should consider this century as the time of prosperity and evolution of learning theories. Before 1950s, it was generally believed that learning was due to the impact of external stimulus, but from the 1950s onwards, researchers were challenged and conducted a series of studies that sh...
متن کاملRelationship between emotional intelligence and occupational exhaustion on nurses
Abstract Introduction: Emotional intelligence is a group of skills that enhances individual's ability to succeed encounter environmental pressures and improve occupational achievement. Objective: The aim of study is to determine relationship between occupational exhaustion and emotional intelligence among nurses. Methods: This correlative descriptive study was done on 240 nurses fr...
متن کاملInduction of Emotions from TOEFL iBT Reading Tests as a Construct-irrelevant Factor and its Interference with Emotional Intelligence
Cognitive appraisal of individuals directs to the creation of an emotional response, which is related to emotional intelligence. The present study shows the presence of induced emotions as an unrelated factor on the construct of a TOEFL iBT reading test which can interplay with emotional intelligence for regulating the induced emotions towards reading passages. The present participants were 393...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Psicothema
دوره 18 Suppl شماره
صفحات -
تاریخ انتشار 2006